Papers with multi-source training
CipherDAug: Ciphertext based Data Augmentation for Neural Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | a novel data-augmentation technique for neural machine translation is based on a letter substitution cipher . a bijective ciphered text is in effect invisible to modern NLP techniques because of its invariant distributional features . |
| Approach: | They propose a data-augmentation technique for neural machine translation based on ROT-k ciphertexts. |
| Outcome: | The proposed method outperforms existing methods on several datasets by a significant margin. |
MAD-G: Multilingual Adapter Generation for Efficient Cross-Lingual Transfer (2021.findings-emnlp)
Copied to clipboard
Alan Ansell, Edoardo Maria Ponti, Jonas Pfeiffer, Sebastian Ruder, Goran Glavaš, Ivan Vulić, Anna Korhonen
| Challenge: | Massively multilingual transformers (MMTs) have benefited from additional training of language-specific adapters, but this approach is not viable for the vast majority of languages due to limitations in their corpus size or compute budgets. |
| Approach: | They propose a multilingual ADapter generation approach which contextually generates language adapters from language representations based on typological features. |
| Outcome: | The proposed method improves cross-lingual transfer performance on part-of-speech tagging, dependency parsing, and named entity recognition tasks while remaining cost-effective. |